Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer

ABSTRACT

An enhanced telephony (ET) computer user interface that seamlessly integrates features of a personal computer (PC) and a telephone into a coherent user interface. The user is provided with a rich variety of functionality that leverages the fact that the PC has considerably more processing power and greater access to variety of data than the ordinary telephone. This processing power and data access is used to the user&#39;s advantage as the telephone&#39;s capabilities and functionality are greatly expanded. Notes and other documents corresponding to a previous call can be identified and presented during a call.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.12/370,579 filed on Feb. 12, 2009, entitled “ENHANCED TELEPHONY COMPUTERUSER INTERFACE ALLOWING USER INTERACTION AND CONTROL OF A TELEPHONEUSING A PERSONAL COMPUTER,” which issued as U.S. Pat. No. 8,635,554 onJan. 21, 2014, and which is a division of U.S. patent application Ser.No. 10/445,395 filed on May 20, 2003, wherein each of the foregoing areincorporated herein by reference in their entireties.

BACKGROUND OF THE INVENTION

1. Technical Field

This invention relates in general to integrated computer telephony andin particular to an enhanced telephony computer user interface thatallows a user to control and manage a telephone from a personal computerwhile seamlessly integrating telephone and personal computer features toprovide a rich user-controlled telephone management system and method.

2. Background of the Invention

Personal computers and telephones are two indispensable devices inmodern life. Personal computers (PCs) and telephones both provide theability to communicate instantaneously with others virtually anywhere inthe world. In addition, PCs have revolutionized modern society withtheir ability to process information and data and to provide a userinteraction with this information and data. PCs also have the capabilityto control other devices. This capability, for example, allows a user toremotely control the peripheral device through a user interface, oftengraphical user interfaces. Even though the PC and telephone often existin the same room, however, there currently exist few attempts to providea useful integration of the two devices that takes full advantage oftheir strengths.

There have been many attempts at integrating the telephone with thepersonal computer, but with little market success. These failures aredue to in part to problems with the product design including, forexample, poor user interface design, the need for expensive additionalhardware, and unrealistic user expectations. In addition, these productsdo not allow a user to access a telephone from a location different fromthe physical location of the telephone.

One product example is the Microsoft® Phone, which was included inMicrosoft Windows® 95. Microsoft® Phone is a software-only speakerphoneand answering machine that allowed a user to use their computer as aspeakerphone. The Microsoft® Phone, however, required that the computeralways be on (which was an unrealistic expectation in the Windows® 95era) and was an expensive added feature to Windows® 95 because itrequired additional hardware. Moreover, the Microsoft® Phone has limitedfunctionality.

Another product example that attempts to integrate the telephone withthe personal computer is the IBM® Realphone. The IBM® Realphone is atelephone-dialing program that is modeled after a standard businesstelephone. The Realphone interface is a picture of the businesstelephone on the display. One problem, however, is that the advantageoussynergies of the telephone and the computer are not merged. For example,the interface requires a user to use an input device (such as a mouse)to press the telephone keypad on the screen and dial a desired telephonenumber, as one would dial a real telephone. However, this type ofinterface is difficult, laborious and time-consuming for a user.

There has been more product success with integrating the telephone andthe computer in the call center environment. For example, the callcenter environment (such as customer support and telemarketing centers)often includes software applications that provide telephone informationsuch as a phone queue display (the order of callers in a queue), adisplay of how many calls are waiting, and the ability to route calls torepresentatives. These software applications are designed for thecustomer service audience, however, and there is little or no attempt tomeet the need of the private user or provide a user-friendly integrationof the physical telephone and the software interface. For the callcenter audience, a priority is to increasing call throughput and quicklyassigning calls in the queue, while the user experience is not.Moreover, telephony applications for the call center environment lackfunctionality and control features needed by an end-user that arecritical for a high-quality user experience.

Therefore, there exists a need for a user interface allowing a user toseamlessly interact with a telephone using a personal computer. The userinterface needed should provide a user with a rich variety offunctionality and take advantage of the processing power of the computerto enhance a telephone's capabilities. Moreover, the user interfaceneeded should provide a tight coupling between the personal computer andthe telephone such that a user is unaware of any division between thetwo.

SUMMARY OF THE INVENTION

The invention disclosed herein includes a computer user interface thatintegrates features of a personal computer (PC) and a telephone into acoherent enhanced telephony (ET) user interface. The ET user interfaceresides on a personal computer and facilitates user control of alltelephone functions using the processing power of a personal computer.More than this, however, the ET user interface includes features thatare only made possible by the use of a PC merged into atelecommunications environment.

The ET user interface overcomes problems with prior attempts tointegrate the PC and the telephone. Specifically, the user is providedwith a rich variety of functionality that leverages the fact that the PChas considerably more processing power and greater access to variety ofdata than the ordinary telephone. This processing power and data accessis used to the user's advantage as the telephone's capabilities andfunctionality are greatly expanded. Moreover, the ET user interfaceprovides a tight coupling between the personal computer and thetelephone such that a user is unaware of any division between the two.This seamless integration, along with enhanced functionality, greatlysimplifies and improves the user experience.

The user can be at a different physical location from the telephone andstill be able to control the telephone using the ET user interface. Theonly requirement is that the ET user interface and the telephone benetwork connected. Thus, the user, as long as he has access to thenetwork, can control the telephone from virtually anywhere.

The ET user interface is designed to operate in both atelecommunications and computer environment, either in an enterprise orhome setting. For example, in the typical enterprise setting, theenterprise owns the telephone equipment tied to the public telephonelines and employees have access to a corporate computer network. Inanother example, in the typical home setting the user has calendar andaddress book data on his PC and has access to a public telephonenetwork.

The ET user interface is designed to control and manage a singletelephone or multiple telephones, including cellular phones, cordlessphones, and desk phone. Moreover, these phones can be located atdifferent locations, such as a mobile phone, a home phone and a workphone. The ET user interface also allows the telephone to be used as anintercom and to provide wakeup calls and meeting reminders.

In general, the ET user interface includes a plurality of environmentsfor the user to choose. These environments include a My Contactsenvironment, a communication preferences environment, and a Call Historyenvironment. Each of these environments contains certain availableprocesses and features for controlling and managing telephones. Theprocesses include actions and collaborations relevant to a contact, atelephone, or both. The features and processes are integrated withdatabases linked to the interface such that information about contacts(such as persons and entities) can be obtained from multiple sources andmerged into a single accessible entry.

The ET user interface includes an environment region, a process region,and an activity region. In addition, the interface includes a callstatus region that keeps a user informed as to a status of controlledtelephones. The My Contacts environment includes processes that allowthe user to initiate, terminate and control both incoming and outgoingcalls from the PC with a minimum of effort. A favorites feature give theuser access to his most popular persons to call, based on a popularitycriteria. A search feature allows a user to search linked databases(such as, for example, corporate and personal address books) for desiredinformation. In addition, the search can be limited to a specificdatabase, such as from the Outlook application running on the PC.

The My Contacts environment includes features to enhance placing a call.In particular, when a call is placed the user receives both visual andaudio cues that keep the user informed of the progress of the call. Oncein the call, a call window appears containing detailed information aboutthe person at the other end of the line and links to previousinformation associated with that person. For example, any documentsopened during previous conversations with the person or e-mails receivedfrom him are listed in the call window such that the user can retrievethem by clicking. An advanced call camp feature allows the ET userinterface to notify the user when a person becomes available if theperson was previously unavailable (such as when the person's line wasinitially busy). Moreover, the advanced call camp feature can beintegrated with the person's calendar to provide the user with the besttime to call the person.

The My Contacts environment includes call transfer and conferencecalling processes. The user can initiate a conference call while in atelephone conversation by merely clicking a button in the interface.Visual and audio cues, from both the PC and the telephone, are used tokeep the user informed as to the progress of the establishment of theconference call. In addition, a synthetic voice can be used toautomatically inform persons being called for the conference call tostand by until all persons have joined the call.

The user is notified of incoming calls both visually and audibly. Invisual terms, an incoming call notification window appears on the user'sdesktop to signal an incoming call. If the telephone system includescaller identification, the caller's telephone number can be matched todetailed information about the caller from the linked databases. Thisinformation then is displayed in the window. The window can also includethe calendar of the caller, so that the user can better decide whetherto answer the call. In audio terms, rich ring tones available from soundfiles played on the PC can signal an incoming call. These sound filescan be caller-specific, such that the user can identify from the ringtone who is calling. The incoming call notification window also includesa quick transfer button. This button enables the user to transfer anincoming call to the user's present location, such as the user's cellphone, when the user is away from the telephone being called.

Another incoming call feature is an unknown contact conversion feature.This feature converts unknown contacts into known contacts using avariety of sources. Thus, if an incoming call is received from anunknown caller (one who is not in the linked databases), then ET userinterface obtains and provides as much information as it can find aboutthe unknown caller in an attempt to determine the identity of thecaller. By way of example, the unknown contact conversion feature canobtain the unknown caller's geographic location based on the area codeof the caller. As another example, the feature can access publicInternet sites to perform a search to find online the person associatedwith the telephone number. Alternatively, the user can provide a namefor the unknown caller. Once the unknown caller's identity isdetermined, the information is saved in the linked databases such thatthe next time the caller calls his identity will be known.

Another feature of the My Contacts environment is a call forwardingfeature that forwards incoming calls to other telephones under certainconditions. These conditions can be specified by the user. In the eventthat an incoming call is missed and the caller does not leave voicemail, the ET user interface can notify the user (such as by an e-mailnotification) that the call has been missed. The missed call e-mailnotification can also contain detailed information about the caller,including the caller's calendar so that the user can determine the besttime to reach the caller.

While in a call, several features enable the user to have a richer userexperience with the telephone and PC combination. A screen sharingfeature allows the user to share the contents of the user's computerscreen with a caller. A PC audio feature adjusts parameters on the PCbased on telephone usage. For example, if the user is listening to asound file on the PC and receives an incoming call, the sound on the PCis automatically muted or slowly lowered and the sound file is paused.Upon termination of the call, the parameters are returned to theirprevious settings.

A notes feature allows a user to create call notes while in a call. Thenotes can have headers intelligently created to aid in indexing,searching and later lookup. The headers contain information about thenotes and the call, such as the call time, subject, and parties involvedin the call. The headers can be call-centric, which means they areassociated with a specific call, or person-specific, which means theyare associated with a particular person. Headers can be created byintegrating information from the linked databases to the notes. Forexample, calendar information can be used to determine the purpose ofthe call, and based on this information headers generated for notescreated during that time period.

The My Call History environment provides the user with access to ahistory of call activity. Items such as incoming call logs, outgoingcall logs, missed calls, and so forth, can be recorded in the callhistory. From this information, the call history environment can providea statistical summary of call usage. Moreover, the ET user interfaceprovides the user with the capability to dial directly a telephonenumber in the call history list or statistical summary.

The communication preferences environment provides a user with a way tonotify others of the user's contact preferences. Thus, if a user prefersto be contacted by e-mail, this information can be contained within thecontact information for the user or relayed to others by means of aicon. In addition, the communication preferences environment allows auser to create groups containing persons or entities and assigngroup-specific rules. For example, these rules can be rules for callforwarding and assigning a specific ring tone to the group. Further, therules can be based on the calendar of each of the group members. The ETuser interface also provides the user with the ability to obtain andchange settings remotely. For example, the user could be notified bye-mail of the current settings for the ET user interface and then changethese settings by sending a return e-mail containing the new settings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention can be further understood by reference to thefollowing description and attached drawings that illustrate aspects ofthe invention. Other features and advantages will be apparent from thefollowing detailed description of the invention, taken in conjunctionwith the accompanying drawings, which illustrate, by way of example, theprinciples of the present invention.

Referring now to the drawings in which like reference numbers representcorresponding parts throughout:

FIG. 1 illustrates an example of a suitable computing system environment200 in which the enhanced telephony (ET) user interface may reside.

FIG. 2A illustrates a first implementation of the ET user interfaceincorporated into the computing and telephone environments where atelephone is not connected directly to a computing device.

FIG. 2B illustrates a second implementation of the ET user interfaceincorporated into the computing and telephone environments where thetelephone and the computing device are connected.

FIG. 3 is a general block diagram illustrating the different sources ofinformation for the ET user interface shown in FIGS. 2A and B.

FIG. 4 illustrates a general overview of the ET user interface shown inFIGS. 2A, 2B and 3.

FIG. 5 illustrates the My Contacts environment of the ET user interface.

FIG. 6 illustrates the search feature tab contained in the My Contactsenvironment shown in FIG. 5.

FIG. 7 illustrates the dialpad feature tab contained in the My Contactsenvironment shown in FIG. 5.

FIG. 8 illustrates the ET user interface as an outgoing call isinitiated by a user.

FIG. 9 illustrates the ET user interface during after the call initiatedin FIG. 8 has been established.

FIG. 10 illustrates the ET user interface during an establishment of aconference call by a user.

FIG. 11 illustrates the ET user interface providing the user with achoice of contacts to conference in after the user request shown in FIG.10.

FIG. 12 illustrates the cues used by the ET user interface to update theuser on the status of the conference call shown in FIGS. 10 and 11.

FIG. 13 illustrates the ET user interface during a conference call thatincludes two callers.

FIG. 14 illustrates the ET user interface during an incoming call.

FIG. 15 illustrates the ET user interface during a quick transfer of theincoming call shown in FIG. 14.

FIG. 16 illustrates an example of an e-mail notification sent by the ETuser interface notifying a user of a missed call.

FIG. 17 illustrates an example of an e-mail notification for an unknowncaller.

FIG. 18 illustrates an example of the Call History environment.

FIG. 19 illustrates the settings process in the communicationpreferences environment of the ET user interface.

DETAILED DESCRIPTION OF THE INVENTION

In the following description of the invention, reference is made to theaccompanying drawings, which form a part thereof, and in which is shownby way of illustration a specific example whereby the invention may bepracticed. It is to be understood that other embodiments may be utilizedand structural changes may be made without departing from the scope ofthe present invention.

I. Introduction

Despite the importance of the telephone and personal computer in mostpeople's everyday lives, the two remain largely disconnected from eachother. Although certain specialized applications exist that link the twodevices for use in areas such as telemarketing and customer servicecenters, the application for personal use has remained essentiallyignored. The enhanced telephony (ET) user interface telephone bringscomputer-telephony to the personal computer desktop to provide a userwith a rich interactive experience that integrates computer andtelephony features for general use.

II. Enhanced Telephony (ET) User Interface Environment

The ET user interface is designed to operate in a combinedtelecommunications and computer environment. In particular, the ET userinterface resides on a computing device. Using the peripheral devices ofthe computing device, a user is able to obtain visual and audioinformation from the ET user interface about telephones in communicationwith the computing device. By way of example and not limitation, aperipheral devices such as a display device and speakers may beconnected to the computing device such that the ET user interfaceinforms the user about the telephones in an audible manner (via thespeakers) and in a visual manner (via the display device).

The following discussion is intended to provide a brief, generaldescription of a suitable computing environment in which the ET userinterface may be implemented. FIG. 1 illustrates an example of asuitable computing system environment 100 in which the ET user interfacemay reside. The computing system environment 100 is only one example ofa suitable computing environment and is not intended to suggest anylimitation as to the scope of use or functionality of the invention.Neither should the computing environment 100 be interpreted as havingany dependency or requirement relating to any one or combination ofcomponents illustrated in the exemplary operating environment 100.

The ET user interface is operational with numerous other general purposeor special purpose computing system environments or configurations.Examples of well-known computing systems, environments, and/orconfigurations that may be suitable for use with the ET user interfaceinclude, but are not limited to, personal computers, server computers,hand-held, laptop or mobile computer or communications devices such ascell phones, PDAs, merged cell phones and PDAs, multiprocessor systems,microprocessor-based systems, set top boxes, programmable consumerelectronics, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of the above systemsor devices, and the like.

The ET user interface may be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a computer. Generally, program modules include routines,programs, objects, components, data structures, etc., that performparticular tasks or implement particular abstract data types. The ETuser interface may also be practiced in distributed computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. In a distributed computingenvironment, program modules may be located in both local and remotecomputer storage media including memory storage devices. With referenceto FIG. 1, an exemplary system for implementing the ET user interfaceincludes a general-purpose computing device in the form of a computer110.

Components of the computer 110 may include, but are not limited to, aprocessing unit 120, a system memory 130, and a system bus 121 thatcouples various system components including the system memory to theprocessing unit 120. The system bus 121 may be any of several types ofbus structures including a memory bus or memory controller, a peripheralbus, and a local bus using any of a variety of bus architectures. By wayof example, and not limitation, such architectures include IndustryStandard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus,Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA)local bus, and Peripheral Component Interconnect (PCI) bus also known asMezzanine bus.

The computer 110 typically includes a variety of computer readablemedia. Computer readable media can be any available media that can beaccessed by the computer 110 and includes both volatile and nonvolatilemedia, removable and non-removable media. By way of example, and notlimitation, computer readable media may comprise computer storage mediaand communication media. Computer storage media includes volatile andnonvolatile removable and non-removable media implemented in any methodor technology for storage of information such as computer readableinstructions, data structures, program modules or other data.

Computer storage media includes, but is not limited to, RAM, ROM,EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disks (DVD) or other optical disk storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand which can be accessed by the computer 110. Communication mediatypically embodies computer readable instructions, data structures,program modules or other data in a modulated data signal such as acarrier wave or other transport mechanism and includes any informationdelivery media.

Note that the term “modulated data signal” means a signal that has oneor more of its characteristics set or changed in such a manner as toencode information in the signal. By way of example, and not limitation,communication media includes wired media such as a wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media. Combinations of any of the aboveshould also be included within the scope of computer readable media.

The system memory 130 includes computer storage media in the form ofvolatile and/or nonvolatile memory such as read only memory (ROM) 131and random access memory (RAM) 132. A basic input/output system 133(BIOS), containing the basic routines that help to transfer informationbetween elements within the computer 110, such as during start-up, istypically stored in ROM 131. RAM 132 typically contains data and/orprogram modules that are immediately accessible to and/or presentlybeing operated on by processing unit 120. By way of example, and notlimitation, FIG. 1 illustrates operating system 134, applicationprograms 135, other program modules 136, and program data 137.

The computer 110 may also include other removable/non-removable,volatile/nonvolatile computer storage media. By way of example only,FIG. 1 illustrates a hard disk drive 141 that reads from or writes tonon-removable, nonvolatile magnetic media, a magnetic disk drive 151that reads from or writes to a removable, nonvolatile magnetic disk 152,and an optical disk drive 155 that reads from or writes to a removable,nonvolatile optical disk 156 such as a CD ROM or other optical media.

Other removable/non-removable, volatile/nonvolatile computer storagemedia that can be used in the exemplary operating environment include,but are not limited to, magnetic tape cassettes, flash memory cards,digital versatile disks, digital video tape, solid state RAM, solidstate ROM, and the like. The hard disk drive 141 is typically connectedto the system bus 121 through a non-removable memory interface such asinterface 140, and magnetic disk drive 151 and optical disk drive 155are typically connected to the system bus 121 by a removable memoryinterface, such as interface 150.

The drives and their associated computer storage media discussed aboveand illustrated in FIG. 1, provide storage of computer readableinstructions, data structures, program modules and other data for thecomputer 110. In FIG. 1, for example, hard disk drive 141 is illustratedas storing operating system 144, application programs 145, other programmodules 146, and program data 147. Note that these components can eitherbe the same as or different from operating system 134, applicationprograms 135, other program modules 136, and program data 137. Operatingsystem 144, application programs 145, other program modules 146, andprogram data 147 are given different numbers here to illustrate that, ata minimum, they are different copies. A user may enter commands andinformation into the computer 110 through input devices such as akeyboard 162 and pointing device 161, commonly referred to as a mouse,trackball or touch pad.

Other input devices (not shown) may include a microphone, joystick, gamepad, satellite dish, scanner, radio receiver, or a television orbroadcast video receiver, or the like. These and other input devices areoften connected to the processing unit 120 through a user inputinterface 160 that is coupled to the system bus 121, but may beconnected by other interface and bus structures, such as, for example, aparallel port, game port or a universal serial bus (USB). A monitor 191or other type of display device is also connected to the system bus 121via an interface, such as a video interface 190. In addition to themonitor 191, computers may also include other peripheral output devicessuch as speakers 197 and printer 196, which may be connected through anoutput peripheral interface 195.

The computer 110 may operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer180. The remote computer 180 may be a personal computer, a server, arouter, a network PC, a peer device or other common network node, andtypically includes many or all of the elements described above relativeto the computer 110, although only a memory storage device 181 has beenillustrated in FIG. 1. The logical connections depicted in FIG. 1include a local area network (LAN) 171 and a wide area network (WAN)173, but may also include other networks. Such networking environmentsare commonplace in offices, enterprise-wide computer networks, intranetsand the Internet.

When used in a LAN networking environment, the computer 110 is connectedto the LAN 171 through a network interface or adapter 170. When used ina WAN networking environment, the computer 110 typically includes amodem 172 or other means for establishing communications over the WAN173, such as the Internet. The modem 172, which may be internal orexternal, may be connected to the system bus 121 via the user inputinterface 160, or other appropriate mechanism. In a networkedenvironment, program modules depicted relative to the computer 110, orportions thereof, may be stored in the remote memory storage device. Byway of example, and not limitation, FIG. 1 illustrates remoteapplication programs 185 as residing on memory device 181. It will beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused.

The ET user interface also is designed to operate in atelecommunications environment. FIGS. 2A and B are general blockdiagrams illustrating two possible implementations of the computing andtelephone environments. FIG. 2A illustrates a first implementation ofthe ET user interface incorporated into the computing and telephoneenvironments where a telephone is not connected directly to a computingdevice.

In this first implementation, the ET user interface 200 resides on auser computing device 205. It should be noted that the computer 110 inFIG. 1 is an example of the user computing device 205. This usercomputing device 205 may be any computing device capable of running anddisplaying the ET user interface, such as a PDA, notebook computer, ordesktop computer. The user computing device 205 is connected 210 to anetwork via a telephony server 215. Once again, the computer 110 in FIG.1 is an example of the telephony server 215.

Residing on the telephony server 215 are Computer-Telephone Integration(CTI) applications 220. CTI applications 220 are system that providecontrol of telephones and receive information about their use. In otherwords, the CTI applications 220 provide the ability to control atelephone and the awareness of what the telephone is doing (such asknowing when the telephone rings). In this first implementation, the CTIapplications 220 reside on the telephony server 215, while in a secondimplementation (described below) the CTI applications 220 reside on theuser computing device 205.

The telephony server 215 is connected 225 to a private branch exchange(PBX) 230, typically belonging to an enterprise such as a corporation.The PBX 230, which usually is located on a company's premises, providesa connection between a telephone 235 and public telephone lines. The PBX230 may also be a central office exchange service (centrex), a type ofPBX where switching occurs at a local telephone station instead of atthe company premises. In this first implementation, the telephone 235 isnot directly connected to the user computing device 205. Instead, thetelephone 235 is connected into the PBX 230 via a connection 240. ThePBX 230 is connected 245 to a certain number of outside lines on apublic switched telephone network (PSTN) 250. A user 255, through the ETuser interface 200, interacts with the telephone 235 and the usercomputing device 205.

FIG. 2B illustrates a second implementation of the ET user interfaceincorporated into the computing and telephone environments where thetelephone and the computing device are connected. In this secondimplementation, the telephone 235 is directly connected to the usercomputing device 205 via a wireless or cable connection 260. The CTIapplications 220 reside on the user computing device 205 instead of thetelephony server 215. The user computing device 205 is either connected265 to a PSTN (as in a home setting) or connected to a PBX (as in anenterprise setting) 270. Moreover, the telephone is also connected 270to either the PSTN or the PBX 270. In both implementations shown inFIGS. 2A and B, the user can use a second computing device (not shown)to remotely connect to the user computing device 205 that is co-locatedwith the telephone 235. Then, user can access the ET user interface 200from the second computing device to transfer incoming calls to anothertelephone (such as a cell phone) at the user's location.

The ET user interface 200 obtains information from a variety of sources.This information then is disseminated to the user 255 using peripheraldevices connect to the user computing device 205 (personal computer, orPC for short). For example, visual information is displayed on a displaydevice and audio information is relayed through speakers or headphones.In addition, the ET user interface 200 allows a user to interact withthe information through input devices connected to the PC, such as akeyboard and a mouse. In addition, the telephone 235 itself is an inputdevice, because the ET user interface 200 uses the CTI applications 220for awareness of the user's 255 interaction with the telephone 235.

FIG. 3 is a general block diagram illustrating the different sources ofinformation for the ET user interface 200. In general, the ET userinterface 200 receives information 300 from a variety of possiblesources. These sources include personal databases 310, enterprisedatabases 320, and public databases 330. The personal databases 310include application-specific databases (such as e-mail, Outlook, instantmessenger, and calendar databases), the enterprise databases 320 includethe hierarchy of the corporation, corporate addresses, calendardatabase, and picture databases, and the public databases 330 includepublic Internet sites and online telephone books. Depending on thenature of its contents, a database may reside on either the telephonyserver 215, the user computing device 205, or both. For example,personal address books and calendar information (from the personaldatabases 310) may reside on the user computing device 205 (such as auser's personal computer), while the corporate hierarchy (from theenterprise databases 320) may reside on the telephony server 215. Theinformation 300 available to the ET user interface will be discussed indetail below in the context of features of the invention.

The ET user interface 200 can derive contact information from thevarious sources mentioned above and merge them into a single contact.For example, contact information from the enterprise databases 320, thepersonal databases 310 (such as an address book), and the publicdatabases 330 can yield multiple telephone numbers and other contactinformation for a single contact. This means that several contactentries exist, even though each entry may be the same person or entity.The contact information integration feature incorporates alleviatesduplication and merges all of contact information and entries into asingle contact entry for display in the ET user interface 200.

In some cases a question may arise as to whether multiple contacts areone in the same person or entity. For example, a contact may be in thecorporate databases 320 under his full name but be listed in a user'sOutlook address book (from the personal databases 310) under hisnickname. In these cases, the user typically is queried as to whetherthe contact found is the same person desired and whether the user wantsto overwrite a new phone number found (such as a new home phone numberfor a person when his old number is in one of the databases).

III. Enhanced Telephony (ET) User Interface Layout

The ET user interface 200 contains several key aspects that provide auser with a rich user telephony experience. Some of these key aspectsinclude the ability to initiate a call in the ET user interface 200(click to call) from virtually anywhere a contact name or telephonenumber appears. Anywhere a contact name (assuming the name can beassociated with a telephone number in the linked databases) or telephonenumber appears in the ET user interface 200, the user merely clicks onthe contact name or number to initiate a telephone call. This greatlyreduces the number of mouse clicks or keyboard strokes required to placea call. Moreover, this click-to-call capability is not limited tocalling a telephone, but can also be expanded to other means ofcontacting a person, such as e-mail and instant messenger.

Another key aspect of the ET user interface 200 is the merging ofcalendar information (such as from a user's personal calendar) and theuser's presence status. In general, the presence status is anyinformation that helps in understanding the user's location at any giventime, what the user is doing, and how a person can contact the user. Byway of example, for a person, presence information includes a person'scalendar, their instant messenger status, applications that arecurrently open on their computer screen, the time since the person lastmoved the mouse or touched the keyboard, their current physicallocation, whether they have their cell phone turned on, whether theirdesk phone is busy, and how many people are in their office. All or someof this presence information can be displayed in the ET user interface200. Thus, based on calendar information, a presence status of the useris made available to others such that others are aware of the best timeand the best (or preferred) means of contacting the user. Other keyaspects of the ET user interface 200 include the unique callnotification features available when the user misses an incoming call,and the unique call routing features that intelligently route anincoming call based on a user's input or integrated calendarinformation.

The key aspects, processes and features of the ET user interface 200 maybe implemented in a variety of ways. Moreover, the appearance of theinterface 200 may vary drastically between implementations. For example,the arrangement of different regions may be different, the number oftabs in each regions may vary, and even the names of the environments,features and process may differ. However, it should be understood thateven though the appearance of the interface 200 may differ betweenimplementations, the key aspects, processes and features describedherein are still within the scope of the invention described herein.

A general description of the layout of the ET user interface 200 willnow be discussed. This is the layout that a user sees and interacts withwhen running the ET user interface 200 on a computing device. It shouldbe noted that this is one implementation of the ET user interface 200,and several other layouts are possible. In general, the ET userinterface 200 is divided into regions. These regions will be discussedwith reference to FIG. 4. Subsequent sections of this paper then willprovide a more detailed description of each of the features that may beincluded in each region.

FIG. 4 illustrates a general overview of the ET user interface 200 shownin FIGS. 2A, 2B and 3. In general, a information 300 is displayed to auser through the ET user interface 200 and functionality is provide suchthat the user can interact with the information 300. Specifically, theET user interface 200 includes a main window 400 that is a standardMicrosoft® Windows® window containing a title bar 410. Below the titlebar 410 is an environment region 420 containing buttons for selectingany number of environments. It should be noted that although fourenvironment buttons are shown, more or less may be included in theenvironment region 420. By selecting one of the environment buttons, theuser causes the ET user interface 200 to display certain features, asdescribed below.

Below the environment region 420 is a call status region 430. The callstatus region 430 provides information about a status of each telephonein communication with the ET user interface 200. For example, if theuser in not in a call, the call status region 430 displays a messagethat states “Not in a Call”. A process region 440 also is include in theET user interface 200. The process region 440 displays the availableprocesses and allows user selection of those processes. Next to theprocess region 440 is located an activity region 450. The activityregion 450 displays feature tabs 460 that correspond to featuresavailable in the environment selected by the user. The processes andfeatures are discussed in detail below.

IV. Feature and Process Details of the ET User Interface

The details of the features and processes associated with the ET userinterface 200 will now be discussed with respect to each of theenvironments.

“My Contacts” Environment

The My Contacts environment provides a user with an interactive means tomanage calls and contacts. This includes incoming calls, outgoing calls,and provides control and management feature while in a call. FIG. 5illustrates the My Contacts environment of the ET user interface. As canbe seen in FIG. 5, the user has clicked on the My Contact environmentbutton 500 to display this environment. The other environments also areshown, namely, the “Bestcom” environment 505, the “My Telephones”environment 510, and the “My Call History” environment 515.

The My Contacts environment 500 includes three main processes in theprocess region 440. The Call Control process 520 provides a user withthe initiate, terminate, and control both incoming and outgoing callsfrom the PC. The Person Details process 525 allows the user to obtaindetailed information about a contact. As explained in detail below, thisinformation may be obtained from a variety of sources and integratedinto a single contact entry. The Collaborate process 530 provides theuser with various ways to get in touch with a contact, including e-mailand instant messaging (IM). In addition, the Collaborate process 530allows the user to access the screen sharing feature, where the user canshare his screen with the caller.

The My Contacts environment 500 also includes five features tabs in theactivity region 450. Namely, the Favorites tab 535, the Recently Calledtab 540, the Search tab 545, the Outlook Contacts tab 550, and theDialpad tab 555. The activity region 450 also includes a search box 560that uses the search feature 545 to search for a contact. It should benoted that a variety of other tabs are possible, and tabs may be addedor deleted according to a user's preferences or corporate policy. Asshown in FIG. 5, the Favorites tab 535 has been clicked, so that theactivity region 450 also displays entries 565, 570, 575, 580 of favoritecontacts. Note that each entry 565, 570, 575, 580 contains a variety ofinformation about the contact. A key feature of the ET user interface200 is that rich information is available for person or entityassociated with a telephone number. In other words, more than just alist of telephone numbers is shown for each entry 565, 570, 575, 580.

Contact Information

Referring to FIG. 5, in the activity region 450 is shown a list offavorite telephone numbers of the user. Note that each entry 565, 570,575, 580 can have an associated picture (if available), name, title,telephone number, and office location. The picture may be obtained fromthe corporate database, the user may specify the picture, or the contactcan supply the picture. It should be noted that although a photograph isshown in FIG. 5, the picture may be any of graphic or textual material.For example, if the contact is an entity (such as a department of thecorporation), the picture may display the department logo. The contactinformation also includes other means of reaching the contact, such as ahome and cellular telephone number and an e-mail address.

The contact information may also contain a presence status in additionto or in place of a picture. The presence status is any type ofindicator that communicates to the user a status of the contact. Forexample, the presence status indicator may be a “happy face” graphicthat is shown in color when the contact is connected to the corporatenetwork or sitting at her computer but is grayed-out when she is notconnected or away from her computer. Similar to instant messaging (IM)services, the presence status provides the user with additionalinformation about the contact. If the user is on the telephone, the ETuser interface 200 knows this and sets the user's presence status to “onthe phone”. The ET user interface allows combined PC/IM user experienceby using presence status and by providing IM contact information.

The presence status can have different levels depending on therelationship between the user and the contact. For example, if thecontact is the user's supervisor, then richer presence information maybe available to the user than would otherwise be available to others inthe company. These levels may be set either explicitly by the user andthe contact, or implicitly based on corporate policies.

Contact information may also include access to the contact's calendar.Of course, the contact would first have to provide consent to make hiscalendar available, either to everyone or to specific individuals of hischoosing. The contact's calendar is loaded into the ET user interface200 such that the user can determine the contact's location at aspecific time or day. By way of example, assume that the user is tryingto call a contact. By bringing up the contact in the ET user interface200 and viewing his calendar, the user can determine when the contact isavailable and the best time to call.

The calendar feature can also be linked to the presence status toprovide additional information about the contact. For example, if thepresence status indicator communicates that the contact is away from hercomputer, the user can consult the contact's calendar and determinewhether the contact is scheduled to be in a meeting or on the telephone.

The contact information includes a map feature that provides a map tothe contact's office location. The map may be accessed through a link tothe corporate database or an Internet connection. Through the ET userinterface 200, the user is able to enter his location and have the mapfeature provide directions to the contact's office. These direction maybe graphical, textual, or both, depending on the user's preference.

Outgoing Call Features

As shown in FIG. 5, the tabs in the activity region include a“Favorites” tab 535, a “Recently Called” tab 540, a “Search” tab 545, an“Outlook Contacts” tab 550, and a “Dialpad” tab 555. It should be notedthat other tabs are possible, and these tabs are only exemplary examplesused in this implementation. Each of these tabs will now be discussed inthe context of a user performing outgoing calling.

“Favorites” Tab

The Favorites feature tab 535 is used to access a favorites listtailored specifically for a user. When the user clicks the Favorites tab535, the favorites list (or a portion therefore) is shown in theactivity region 450 of the ET user interface 200. In general, thefavorites list is a list of the user's favorite or most populartelephone numbers to call. The favorites list allows a user to quicklyand easily call frequently-called contacts (similar to an enhanced speeddial). The popularity of the telephone number can be based on a numberof criteria. By way of example, the criteria may include the user'scalling frequency of the telephone number, how recently a number wascalled, a relationship between owner of the telephone number and theuser (such as higher popularity to a user's boss and spouse), and auser's explicit instructions. Based on this popularity criteria, theuser or the system can add or remove telephone numbers from thefavorites list.

The favorites list can be generated or populated in a number of ways,both automatically and manually. For example, the user can manuallyconstruct his favorites list from his personal databases 310, from theenterprise databases 320, from the public databases 330, or all of theabove. The favorites list may populated with the other persons in theuser's department, group or team along with the user's supervisors towhom he reports. The user can add still more favorites as he desires.

The favorites list may also be populated automatically. This automaticpopulation of the favorites list can be performed by an analysis ofvirtually any database to which the user has access. For example, thefavorites list may be populated using the user's e-mail database. Inthis situation, the ET user interface 200 obtains data about who theuser sends e-mails to, receives e-mails from, or both and constructs alist. The top n numbers on the list then are used to populate thefavorites list. The number n may be selected by the user (through the ETuser interface) or selected automatically. As another example, the ETuser interface 200 can have access to a list of calls recently made theuser. Once again, the top n numbers can be used to populate thefavorites list. It should be noted that the favorites list can bepopulated from a single list or database or multiple lists or databases.

Another type of automatic population (or pre-population) occurs atstartup. At startup, the user typically will not have a list offavorites and will need to populate the favorites list. The ET userinterface 200 includes an automatic customization feature that helps auser add telephone numbers to the favorites list. As described above,this automatic customization feature at startup initially populates thefavorites list by an analysis of a database containing telephonenumbers, explicit user input, or both. By way of example, in theenterprise setting the favorites list may be pre-populated at start upbased on the corporate organizational structure available from theenterprise databases 320. For example, the user's favorites list mayinclude members of his department including his immediate supervisor.Once the favorites list has been populated using the automaticcustomization feature, the favorites list can be revised and changedeither automatically or manually as desired, as described above.

“Recently Called” Tab

A Recently Called feature tab 540 also is included in the ET userinterface 200. This tab 540 allows a user to access a list ofrecently-called telephone numbers made by the user. The top n recentlycalled telephone numbers can be used to populate the recently calledlist. It should be noted that the recently called list can be populatedfrom a single list or multiple lists.

“Search” Tab

The ET user interface 200 includes a search feature tab 545 thatprovides a user with a rich searching experience. By clicking the searchtab 545, the user can interact with a powerful search feature displayedby the ET user interface 200 that gives the user the capability tosearch all linked lists and databases. The search feature allowssearching based on a number of different criteria (such as first name,last name, nickname, phone number, alias, building, department, officenumber, etc.). The search feature can perform the search within any ofthe linked lists or databases, the computing device running ET userinterface 200 (such as a client), or on a backend server (such as thetelephony server 215).

FIG. 6 illustrates the search feature tab 535 contained in the MyContacts environment 500 shown in FIG. 5. In particular, in FIG. 6 theuser has clicked on the search feature tab 535 and entered a searchquery 600 into the search box 560. Based on the query 600, the searchfeature has returned several possible matches 610, with the highestprobable match being displayed first and the other displayed indescending order. These possible matches 610 were obtained by searchingeach all of the information 300 available to the ET user interface 200.The search feature also includes visual cues that inform the user whichdatabases are being searched. For example, icons representing theavailable databases can be used to inform the user which databaseresults were found. These results then are displayed with accompanyingicons representing the databases where the results were found.

“Outlook Contacts” Tab

The “Outlook Contacts” tab 550 is a feature of the ET user interface 200that integrates all contacts contained in Microsoft® Outlook. TheOutlook contacts feature is useful if the user interacts mainly withpersons outside the company rather than inside the company. In thiscase, the user frequently accesses his Outlook databases (within thepersonal databases 310) rather than the enterprise databases 320.Multiple telephone numbers from Outlook are shown in a pull-down menuwithin the ET user interface 200.

“Dialpad” Tab

The “Dialpad” feature tab 555 of the ET user interface 200 allowsexplicit dialing of a telephone number. FIG. 7 illustrates the dialpadfeature tab 555 contained in the My Contacts environment 500 shown inFIG. 5. When the user clicks on the “Dialpad” tab 555, a telephonedialpad 700 is displayed in the activity region 450. The user can use aninput device (such as a stylus or mouse) to enter a telephone number ina text box 710 and click a Dial button 720 to dial the number. If theuser makes a mistake entering the telephone number, a Clear button 730can be used to erase the last number entered. The dialpad feature isuseful on a computing device (such as a personal digital assistant(PDA)) where the user may not have a keyboard and may want to enter anumber by tapping on the dialpad 700.

Placing an Outgoing Call

Placing an outgoing call in the ET user interface 200 will now beexplained with reference to FIG. 8. FIG. 8 illustrates the ET userinterface 200 as an outgoing call is initiated by a user. To place acall, the user clicks on a desired number 800 (shown as the thirdcontact 575). If the telephone 270 linked to the ET user interface 200is a speakerphone, the speakerphone goes off hook and the user hears thefamiliar telephone ringing sound. In addition, if the linked telephone270 has a display, the number dialed is displayed on the phone displayalong with the person being called. It should be noted that although theperson being called was selected from the Favorites list (as shown inFIG. 5), the call could have been initiated by the user from any of theother tabs in the “My Contacts” environment 500.

FIG. 9 illustrates the ET user interface 200 during after the callinitiated in FIG. 8 has been established. A call window 900 appears inthe activity region 450 with the callee information 575 being displayedat the top of the call window. A notes area 910 is contained in theremainder to of the call window 900, which allows the user to use thenotes feature discussed below. The call status region 430 indicates thatthe user is “On the Phone” 920. In addition, included in the environmentbutton area is a hang-up button 930 that allows the user to terminatethe call. In addition, the call may be terminated using the Hang Upprocess in the Call Control process region 520.

The call window 900 may also appear by the user picking up thetelephone. When the ET user interface 200 receives input that thetelephone is off the hook, the call window 900 appears asking the userwhat number he would like dialed. Moreover, if the user dials the callfrom the telephone, the ET user interface 200 displays an in-call window(described below) and automatically recognizes the number called (if thenumber is in the databases). Moreover, the ET user interface 200 canbring up an address book or the favorites list automatically wheneverthe user takes the telephone off hook.

The ET user interface 200 can be customized to implement a company'sdialing plan and policy for outgoing calls. As a simple example, thecompany dialing plan may require a “9” to reach an outside line. As amore complex example, company policy may dictate that a long distancecertain carrier be used at specific times of the day and another be usedotherwise. The ET user interface 200 can be customized to implement acompany's dialing policy automatically without continual userintervention. Thus, the user can enter (either by cutting and pasting ordirectly from an input device) a telephone number and the ET userinterface 200 will take care of all dialing policies and procedures. Forexample, if the user does not know how to dial a foreign country hesimply enters the number and as the ET user interface 200 to dial forhim. As another example, when the user is in a hotel and needs to dialout, the ET user interface 200 takes care of all dialing protocols toplace the call without the user intervention.

Another feature of the ET user interface 200 is advanced call “camp”. Ifthe user is trying to call someone and the person is unavailable, theadvanced call camp feature notifies the user when the person becomesavailable and offers to place the call. In addition, the ET userinterface 200 can use the callee's calendar to provide the user with thebest times to call such that the person will be available. For example,the ET use interface 200 can monitor the messenger status of the personor the person's keyboard to determine when the person becomes available.

Other features can be used in the ET user interface 200 because it runson a powerful PC that is linked and has access to a variety ofdatabases. One such feature is the voice command feature. For example,with speech-to-text software (voice recognition software), the ET userinterface 200 can process voice commands from the user. Thus, the usercan vocally ask the system to call a certain person. For contacts withthe linked databases, there is no training required. This is because theET user interface 200 is linked to certain databases (such as theenterprise databases 320 and the personal databases 310) and is alreadyaware of the contact being requested.

Call Transfer and Conference Calling Processes

Many telephones have the capability to transfer and conference calls.However, many people simply do not know how to use them. That is whymany times you hear someone at the other end of the line say “if I loseyou during this transfer or while trying to set up this conference call,please call back.” The ET user interface 200 simplifies call transferand conference calling for the user.

FIG. 10 illustrates the ET user interface 200 during an establishment ofa conference call by a user. In particular, in order to establish theconference call the user clicks on a conference button 1000, under the“Call Control” process 520 in the process region 440. Note also that theuser has made notes 1010 in the notes area 900, in accordance with thenotes features discussed below. FIG. 11 illustrates the ET userinterface 200 providing the user with a choice of contacts to conferencein after the user request shown in FIG. 10. This gives the user all thefeatures tabs of the “My Contacts” environment 500. In other words, theuser can select contact from the Favorites tab 535, the Recently Calledtab 540, the Outlook Contacts tab 550, or click the Search tab 545 toperform a search or the Dialpad tab 555 to use the dialpad to call.Using one of these methods, a person can be called and added to theconference call.

ET user interface 200 also provides visual and audio cues to the userregarding the status of the call. FIG. 12 illustrates the cues used bythe ET user interface 200 to update the user on the status of theconference call shown in FIGS. 10 and 11. Specifically, the user selectsa contact to include in the conference call and clicks on his telephonenumber 1200. As shown in FIG. 12, the contact is an unknown contact 1210having an entry. A status window 1220 appears notifying the user thatthe person selected (the unknown contact 1220) is being included in theconference call. In addition to these visual cues, the telephone itselfalso provides audio cues (such as hearing the telephone dial). Theseaudio cues provide the user with the capability to recognize any errorsthat may arise during the calling process and intercede. For example, ifa line is busy, then the user can recognize that fact by hearing thebusy tone and can choose to dial another number where the contact may bereached. The status window 1220 then informs the user to click “OK” 1230when the person answers. This conferences the person into the conferencecall. If the person does not answer, the user can click “Cancel” 1240 tocancel the conference call. FIG. 13 illustrates the ET user interface200 during a conference call that includes two callers, namely, theknown caller 575 and unknown caller 1210.

There are a number of other ways that the ET user interface 200 allows auser to establish a conference call. One way is by allowing the user todrag and drop a contact from other user interfaces and applications(such as an Outlook contacts list) and conference in those persons.Another way is that the user can right click on a contact and select theline, “join conference call”. Still another way is that the user canselect all people on a “To:” line from an e-mail and right click on“conference call”. All of the selected people then are joined into aconference call. Moreover, groups can be created so that the user needonly click on the group to establish a conference call includingeveryone in the group. In some embodiments of the ET user interface 200,a synthetic voice or a recorded user voice is used to inform eachcontact being called for the conference call to wait until the entireconference call is established.

Incoming Call Features

The ET user interface 200 notifies the user of incoming calls bothvisually and audibly. FIG. 14 illustrates the ET user interface 200during an incoming call. Visually, the user is notified on his desktop1400 of the incoming call by an incoming call notification window 1410.If caller identification is available on the telephone network and thetelephone number is in any of the linked databases, the window willinclude the entry of the caller 575 containing contact informationdiscussed above. If the user decides to answer the call, he simplyclicks the Answer button 1420 and is connected with the caller. The ETuser interface 200 instructs the telephone to pick up (or go “offhook”). If the telephone is a speakerphone, the ET user interface 200also instructs the telephone to go to speakerphone mode such that theuser can either talk using the speakerphone or pick up the handset. Thecall notification window 1410 also includes a quick transfer button 1430discussed below. With the quick transfer button 1430, the user is ableto quickly transfer the incoming call to an alternate telephone.

The user also has a variety of options for the incoming call. The usercan send an incoming call directly to voice mail by clicking a “SendDirectly to Voice Mail” button (not shown) on the incoming callnotification window 1410. Alternatively, this could be an option listedunder the quick transfer button 1430. Either way, when the user clicksthis option the ringing immediately stops and the caller is sentdirectly to voice mail. In another alternate embodiment, the ringing issilenced but the caller does not go directly to voice mail. Instead, thecaller is sent to voice mail after the set number rings, but the ringingis silenced.

In addition, the ET user interface 200 provides the user with optionswhen the user receives an incoming call while in a call. The ET userinterface 200 allows the user in the call to send an instant message ore-mail to the caller notifying the caller that the user is on the phoneand send the caller to voice mail. The voice mail can becaller-specific, whereby different voice mail messages are useddependent on the identity of the caller. For example, the user'ssupervisor and co-workers may get a more personalized voice mail messagewhile those less familiar to the user may get less personalized andgeneric message.

The ET user interface 200 also gives a user call blocking options. Theuser may specify call blocking by clicking on a “block number and sendto voice mail”. Whenever the caller from the blocked number calls again,the call is sent directly to voice mail without ringing. Alternatively,the user may choose to block calls completely from that number, in whichcase the caller may hear a message stating that the user is no longeraccepting calls from their number.

If the incoming caller is using the ET user interface 200, the callercan also receive alternatives to a busy signal. For example, if thecaller tries to call the user but the user is on the phone, a dialog boxwill appear in the caller's ET user interface 200. The dialog box cangive the caller a variety of options, such as leave a voice mail, sendan e-mail, send an instant message, notify me when the user is off thephone, do nothing, just to name a few. If the “notify me when the useris available” option is selected, a dialog box pops up on the caller'sscreen when the user is available and asks the caller if he would liketo place a call to the user.

The user is also notified audibly of the incoming call. This isaccomplished using ring tones through speakers of the PC. The PC hasmuch richer speakers than a cell phone or desk telephone and allow agreater variety of ring tones. In addition, any sound file can be usedto indicate an incoming call. The ET user interface 200 permits a userto turn off the ringer on the telephone and have the ring of an incomingcall broadcast through the PC speakers. The advantage to this is thatyou can have a unique ring from your neighbor because there is a widervariety of sound files to choose from for a PC than from a cell phone ortelephone.

The ET user interface 200 also provides audio as well as visual calleridentification through the use of caller-specific ring tones. This meansthat the user can hear not only that his phone is ringing, but hear whothe call is from based on the ring tone. The user then can decidewhether to answer the call. In another embodiment, the sound fileidentifying a caller can be in the caller's voice. By way of example, acaller may identify himself in his own voice as “this is James calling”.Other embodiments of the ET user interface include text-to-speechconversion such that the textual caller identification is read andconverted into speech. In this manner, a synthesized voice can announcethat the user has an “incoming call from James.”

The incoming call notification window 1410 can also include the calendarof the person calling (not shown). Based on the caller's calendar, theuser may make different decisions about answering the incoming call. Forexample, if the user sees from the caller's calendar that the caller hasfree time now but is in meetings for the rest of the day, the user maychoose to answer the call. Similarly, if the user sees from the calendarthat the caller is out of the office today, the user can decide toanswer the call because the caller may need help with a matter. Thisadditional information provided by the user's calendar aids the user indeciding whether to answer the call.

Quick Transfer Feature

Once a user is notified of an incoming call, the ET user interface 200provides the user the option of performing a quick transfer. FIG. 15illustrates the ET user interface 200 during a quick transfer of theincoming call shown in FIG. 14. Referring to FIGS. 14 and 15, theincoming call notification window 1410 includes the quick transferbutton 1430 labeled, “Transfer to:”. As shown in FIG. 15, the drop downvertical list 1500 includes the choices, “cell phone”, “home” and“Monica”. As noted above, the list 1500 may also include the option tosend the caller directly to voice mail or to silence the ringing. Thisquick transfer feature can be used to transfer an incoming call to atelephone near the user when the user is away from the telephone beingcalled. By way of example, suppose that the user is on the road and hashis wireless notebook computer (running the ET user interface 200) andhis cellular telephone. Back at his office is the user's work computeris running ET user interface 200 and his desk phone. Assume that anincoming call is received from someone calling the user's officetelephone. As long as the user is connected to the network (such as viathe wireless notebook computer), the user can use the quick transferfeature to immediately transfer the incoming call to the user's cellphone.

The user pre-configures the ET user interface 200 with the telephonenumbers of locations where the user may be located. In addition, thecalendar feature may be used to automatically determine the location ofthe user (based on his calendar) and add telephone numbers to the quicktransfer list based on the calendar. This automatic population of thequick transfer list 1500 using calendar information allows the user totransfer incoming calls to a telephone at his present location. Forexample, if the user's calendar says that he is in a meeting in aconference room from between 9 and 10 in the morning, the ET quicktransfer list 1500 would include the telephone number of the conferenceroom during that time period. As shown in FIG. 15, the user has receivednotification of an incoming call at his work office and has activatedthe quick transfer button 1430 to ring the incoming call at his hometelephone number. The quick transfer feature of the ET user interfaceprovides flexibility and lessens the chance that the user will missimportant calls.

Call Forwarding Feature

The ET user interface 200 provides a user access to a call forwardingfeature that forward calls to other telephones under certain conditions.These conditions can be configured by the user. For example, the usermay want all incoming calls forwarded to his cellular phone every timehis computer is locked. Other call forwarding conditions include: (a)forward all calls when the screen saver comes on; (b) forward all callswhen my presence status is set to away or busy; and (c) forward allcalls at certain times. For example, on Tuesday and Thursday the usermay telecommute, such that all calls on those days are forwarded to herhome telephone. The call forwarding feature also can be integrated withthe calendar feature such that the feature recognizes from the calendarthe location of the user at a certain times of the day and forwards (oroffers to forward) all calls to a telephone at that location or to theuser's cellular phone.

The ET user interface 200 also includes a “call hunt” feature. If thereis no answer at a first number, the call hunt feature keeps tryingdifferent numbers in a “hunt group” where the user may be found. Thealternate numbers in the hunt group can be provided by the user orautomatically configured based on information from the linked databasessuch as calendar information. For example, if a caller is trying toreach a user at the user's office but there is no answer, the ET userinterface 200 can attempt to reach the user at alternate numbers, suchas the user's cell phone.

Missed Call Feature

In the event that a user misses an incoming call, the ET user interface200 provides a missed call feature. Typically, the missed call featureis activated when a call is missed and the caller does not leave a voicemail message. FIG. 16 illustrates an example of an e-mail notification1600 sent by the ET user interface 200 notifying a user of a missedcall. The e-mail notification 1600 can be sent to any device capable ofreceiving e-mail, such as a computer or a cellular phone. One aspect ofthe missed call feature is that the ET user interface sends the e-mailnotification 1600 to the user setting forth the identity of the caller1610, the time and date of the missed call 1620 and contact information.For example, as shown in FIG. 16, this contact information includes thecaller's telephone number 1630 and the caller's e-mail address 1640. Inaddition, the e-mail notification 1600 includes instructions 1650 on howto turn off the e-mail notification feature.

The missed call e-mail notification 1600 can also contain buttonsproviding contact functionality. These buttons include a “call themissed caller back” button, an “e-mail the missed caller” button, and“use instant messenger to contact the missed caller” button. The userneed only click any of these buttons to perform the desired action. Themissed call notification e-mail 1600 also can use the caller's calendarinformation and present the caller's calendar. For example, the e-mailcan contain a notice that says “you missed the caller, and here is herschedule for the day”. Her calendar then is presented. The user thenlooks at the missed caller's schedule and decides the best time toreturn her call. The missed call notification e-mail also can containeven richer information, such as the caller's picture. In addition, themissed call notification e-mail 1600 can include the voice commandfeature such that a user can verbally command the ET user interface 200to contact the caller by any available method.

In some situations the incoming caller may be unknown. This can occurwhen the incoming caller's telephone number or other contact informationcannot be found in the linked databases. In this unknown callersituation, the ET user interface 200 includes an unknown caller featurethat can take a variety of actions. First, the unknown caller featurecan provide as much information as possible to the user about theunknown caller. This can be done, for example, by area code lookup or asearch of public Internet sites. In other words, the unknown callerfeature can display to the user the geographic region from where thecall originated, based on the area code. In addition, the unknown callerfeature can perform a search of public Internet sites to find a name forthe telephone number. This can include searching public telephone booksand other public records.

The e-mail notification is different in the situation where the calleris unknown. FIG. 17 illustrates an example of an e-mail notification foran unknown caller. The unknown caller e-mail notification 1700 can besent to any device capable of receiving e-mail, such as a computer or acellular phone. The ET user interface sends the unknown caller e-mailnotification 1700 to the user setting forth the telephone number of thecaller 1710, the time and the time and date of the missed call 1720. Inaddition, the unknown caller e-mail notification 1700 also includesgeographic information based on the caller's area code and the abilityto perform a search on public Internet sites 1740. The search isperformed on the public Internet sites 1740 to perform reverse look-upsof telephone numbers. Moreover, the unknown caller e-mail notification1700 includes instructions 1750 on how to turn off the e-mailnotification feature.

The unknown caller feature also can intelligently determine whether theunknown caller e-mail notification should be standard or customized. Thestandard notification is based on the caller's name or number. There maybe cases, however, when the name or number is not important, but, forexample, the position of the person calling is important. For example,if a caller dials a corporation's main number and talks with an operatorwho then transfers the call, the standard e-mail notification wouldidentify the caller as the company operator. In this situation, theoperator's position is more important that the operator's name ornumber, and a customized e-mail notification would be sent. The ET userinterface 200 can use linked databases (such as the enterprise database)to decide whether to send standard or custom e-mail notification.

In-Call Features

The ET user interface 200 provides can display several features andprocesses to a user during the initial stages of a telephone call andduring the call.

Screen Sharing Feature

The screen sharing feature allows a user's computer to send instructionsto display visual data to the computer attached to the caller'stelephone. In other words, screen sharing is enabled if the user and acaller are in a call and if both callers are on the corporate network.There are two implementations of the screen sharing feature. A firstimplementation involves sharing the contents of the user's screen one ormore callers. As shown in FIG. 5, if the user is talking to a caller andwants to share his screen, the user clicks the “share your screen”button under the Collaborate process 530. The caller then receives amessage confirming that this is approved by the caller. This establishesa screen-sharing session between the user and caller. The screen callfeature can be configured to share only a part of the screen, all of thescreen, or an application-specific part of the screen (for example, theword-processing document open in a window on the screen. When the callis terminated, the screen-sharing session is automatically discontinuedand all windows associated with the call and session are automaticallycleaned up.

A second implementation of the screen sharing feature is a screen callfeature. The screen call feature allows a user to call a business and toreceive from the business a web page or other visual data associatedwith the business. The business has previously programmed its computerto send all callers its web page or other visual data. The screen callfeature merges audio features of the telephone and PC with the visualfeatures of the PC to provide information in a business setting. Forexample, assume that the user calls his favorite restaurant. While theuser is on hold, the screen call feature can bring up the restaurant'sweb page, menu or available reservations, so that the user can browsethis information while on the phone. Moreover, depending on its productor services, a business could provide information to the user via screensharing such as a list of frequently asked questions, a movie listing,and a pricing list, just to name a few. The screen call feature also maybe used to ease the burden of phone menu trees that require a user toselect an option numerous times to get to the desired option. Using thescreen call feature, the business could share its phone menu tree,thereby allowing the user to click on the menu tree for the desiredoption and letting the ET user interface 200 handle the task of reachingthat option.

In addition, the ET user interface 200 includes an easy transfer featurethat sends a file while in the call. This easy transfer feature sharesmultiple copies of the file while in a call with whomever the userchooses. By way of example, if the user is in a conference call withthree other callers and they are discussing a document that the otherthree do not have, the user can click the easy transfer button and acopy of the document appears on the desktop of each of the threecallers.

PC Audio Feature

The ET user interface 200 can adjust parameters on the PC based on theuser's telephone usage. This is made possible by the fact that the ETuser interface 200 is aware of the telephone and can act intelligentlyaccordingly. Thus, the moment the ET user interface 200 knows what thephone is doing the ET user interface 200 can adjust certain parameterson the PC. For example, when the user picks up the telephone the audioon the PC is affected. This means that the audio on the PC may be mutedor lowered, as desired by the user. In addition, the PC shows a visualindication that the volume has been affected. For example, the volumeicon displayed on the screen may show that the audio has been muted.Alternatively, a message may be displayed that the audio has been mutedor turned down.

If the user is listening to music when a call is received or placed, theaudio can be muted upon initiation of the call. In addition, the PC canpause the music at that location instead of turning the music off andforcing the user to listen to the beginning of a song upon terminationof the telephone call. If the telephone call is, for example, a voiceover IP (VOIP) call, the PC will sense this and act accordingly byswitching the speakers from the audio to the telephone call andactivating the microphone.

An alternate embodiment includes automatically lower the audio insteadof muting it. In other words, upon receipt of initiation of a call, theaudio is slowly lowered and then muted, while the music is paused. Uponcall termination, the music is unpaused and then the audio volume israised from mute to the previous level before the telephone call. Thisembodiment avoids the situations where the user has his audio on at ahigh volume, takes a phone call, and then upon termination of the callthe audio returns to its high volume, thereby startling the user.

Notes Feature

The notes features of the ET user interface 200 provides support theuser while in a call, while making a call, and while receiving a call.Referring to FIGS. 9 and 10, during the call, can take notes (such asaction items) in the notes area 910. The user can take notes during thecall and the notes will become part of the call history. In this manner,any notes made during a call are associated with the call. The notes canbe any type of notes, such as text notes or Tablet PC format. Inaddition, these notes can be stored and indexed. This allows the user tosearch the notes using the search feature described above.

The notes features also can intelligently create headers andassociations for the notes made during the call. These headers andassociations can be automatically generated from data available to theET user interface 200, such as Outlook calendar data. For example, ifthe user has a meeting request in her calendar during the period that acall is placed or received, the notes feature looks to the Outlookcalendar data to see what is scheduled. If, for example, there isscheduled a meeting to discuss a sale of a product, this data can beused to create a header for any notes created during the call, where theheader states that the notes related to the sale. The notes featureattempts to match the call with the calendar items using, for example,caller identification, a meeting identification, or attempts to matchthe information between the calendar and the call. If a match isdetected, the notes feature associated the notes created during the callwith the meeting. In addition, this calendar data can be used to createnote headers and such.

Event History Feature

The ET user interface 200 also can display an event history associatedwith one or more callers. This event history can be displayed for bothincoming and outgoing calls to a particular caller for whom the user hashad prior contact. The event history contains events such asappointments, prior telephone conversations, e-mails, notes anddocuments associated with a caller. The events are associated with thecaller at the time of a call, and when the caller calls again, links tothe events are displayed in the ET user interface 200. The event historycan be displayed for a caller in the incoming call notification windowand when the user is placing an outgoing call. Through the ET userinterface 200, the user also can manually edit the event history to makeit more useful.

By way of example, assume that a user receives a call from a caller withwhom the user has had previous conversions. Further assume that the userand caller have previously discussed a certain document, which the userhas opened during the course previous telephone conversations. Thesedocument may be, for example, a word processing or a spreadsheetdocument. The event history feature has previously linked that documentwith the caller and his previous telephone calls to and from the user.When a call is received from the caller, the incoming call notificationwindow includes a listing of the document associated with the caller,and includes a link to the documents to enable the user to quickly openthe document while answering the call. In other words, when a call isplaced or received from the same caller at a later time, the eventhistory feature remembers the events associated with the caller and theET user interface 200 provides a list of those events during incoming oroutgoing calls to the caller.

Other Uses of the Telephone

The ET user interface 200 allows a telephone to be used in other lesstraditional ways. For example, the ET user interface 200 can be used toprovide wake-up calls or meetings reminders for the user. The user wouldsimply enter into the ET user interface the times she wanted her phoneto ring to be reminded of something or awakened. At the prescribed time,the telephone is directed to ring and a reminder or wake-up call isprovided. Moreover, the telephone can be used as an intercom (such asbetween offices). A user requests to intercom another person and anintercom request is sent to the person. The person's ET user interface200 receives the intercom request and instantly takes the person'stelephone “off hook”. The user and the person then are connected in anintercom setting.

“My Call History” Environment

The My Call History environment 515 provides a user with access to ahistory of all call activity within a previous period of time. In itsbasic form, the call history feature tracks all incoming and outgoingcalls, including the length of call, participants, when and where thecall occurred. Richer versions of the call history feature also includenotes associated with the calls. The call history also can include anevent history for each call, containing events associated with aparticular caller. Other versions of the call history feature includetracking of all transferred, forwarded and missed calls, including amessage that an e-mail was sent notifying the user of any missed calls).The call history feature can be configured to display information formultiple phones, such as a work phone, home phone, and cell phone.Moreover, the call history feature contains the capability to dialdirectly. In other words, while viewing the call history in the ET userinterface 200, a user need only click on a telephone number to initiatea call to that person.

The call history feature can include a statistical summary of callusage. This statistical summary provides a succinct digest of a user'stelephone behavior over a certain time period. For example, thestatistical summary may inform the user of the number of calls he madetoday and the average number of minutes per call, and the average numberof minutes spent on the telephone during the day or week. In addition,the statistical summary can provide reports chronicling a user's timespent on the phone for each day, each month, or some other time period.The call history feature can be configured to automatically remove callhistory logs and information after a specified time period. The timeperiod may be determined, for example, by a company's retention policy.

FIG. 18 illustrates an example of the Call History environment 515. Acall history log 1800 is displayed in the activity region 450. This log1800 contains a list of all incoming and outgoing calls as well as apreview of any notes that were taken during the call. If the user doubleclicks on an entry in the log 1800, a window is opened detailing thebasic information (such as data/time of the call, caller, telephonenumber) and all the notes. Processes 1810 for modifying the log 1800 areshown in the process region 440. In particular, the processes 1810include deleting individual log entries, delete all log entries, viewselected log entries, and export the call history. Other processes maybe added depending on the needs to the individual or enterprise.

My Telephones Environment

The My Telephones environment 510 allows a user to identify, configureand manage the telephones in communication with the ET user interface200. Identification and configuration such that the telephones willcommunicate with the ET user interface 200 can be performed manually orautomatically. Automatic identification and configuration is performedbased on the linked databases. The My Telephones environment 510 alsoprovides status information regarding telephone and networkconnectivity.

Bestcom Environment

The Bestcom environment 505 is a communication preferences environmentthat provides a user with a means to configure and communicate to othersthe user's preferred modality of being contacted. In other words, theBestcom (or communications preferences) environment 505 uses rules toroute calls. These rules allow a call to be forwarded to a number basedon a certain condition. For example, the user may state that hiscommunications preferences are to have all calls forwarded to a certainnumber (such as his home phone) whenever his computer is locked. Inaddition, communication preferences of the use can be configured andcommunicated to others. For example, if a user prefers to be contactedby e-mail, this can be communicated to others through the ET userinterface 200 (such as using an icon or text message). Thecommunications preference environment 505 allows the user to notifypotential callers of the way in which the user prefers to be contacted,thus improving the chances of contacting each other.

The ET user interface 200 serves as a means to collect and disseminatethe user's communication preferences. The way these preferences arecommunicated include in the contact information, such as next to theperson's telephone number and picture, and a communication preferencesicon of some common states such as, for example, do not telephone,prefer e-mail, and please call. Because they are located in the contactinformation, these communication preferences would show up to a usersearching for someone.

As an example, a user could set her communication preferences to certainsettings such as: (a) please call any time; (b) prefer e-mail, but callif it is important; (c) please do not call; (d) send e-mail or stop by.These are merely examples of the multitude of settings that areavailable to convey the user's preferences. In addition, there could beother variations and dimensions to these communication preferencessettings. For example, the settings may be based on the date, the timeof day, the caller, and the user's presence status, to name a few.

FIG. 19 illustrates the settings process in the Bestcom or communicationpreferences environment 505 of the ET user interface 200. The processregion 440 includes the Bestcom Settings process 1900, which allows theuser to set communications and call forwarding preferences. As shown inFIG. 17, the user interface options for the Bestcom Settings process1900 are displayed in the activity region 450.

In particular, the Bestcom Settings process 1900 allows the user to usethe basic settings 1910 configured by the user. The user has the optionof a Do Not Disturb status 1920, which sends all incoming calls directlyto voice mail. In this example, the user has configured the settingssuch that an incoming call is forwarded to her cell phone 1930. This isperformed only when the computer is locked 1940. Other settings arepossible, as shown in FIG. 19. For example, the user can forward allcalls to her cell phone. In addition, the PC can have a connectedmicrophone that distinguishes between voices or a camera connected tothe PC running face recognition software that detects other people inthe room (other than the user). If the PC detects more than one personin the room or otherwise determines that there are persons other thanthe user in the room (either through audio or visual means), then the PCcan automatically configure the settings to send all incoming calls tovoice mail. Moreover, the settings can include a “breakthrough” listthat allows call from certain people to get through. For example, a usermay not want to be disturbed unless an incoming call is from a manageror a spouse.

The Bestcom environment 505 also allows remote notification andmodification of settings. For example, the user can request by e-mailthe current settings of the ET user interface. Once received, the usermay decide to modify the settings. The modified settings can be e-mailedback to the ET user interface and applied.

The foregoing description of the invention has been presented for thepurposes of illustration and description. It is not intended to beexhaustive or to limit the invention to the precise form disclosed. Manymodifications and variations are possible in light of the aboveteaching. It is intended that the scope of the invention be limited notby this detailed description of the invention, but rather by the claimsappended hereto.

What is claimed is:
 1. A computer-implemented method implemented forfacilitating the taking of notes during a telephone call and for linkingthe notes to a history associated with the telephone call, the methodcomprising: a computing system detecting a telephone call that isreceived at the computing system, the computing system including aprocessor and memory and capabilities of connecting the telephone callwith at least one participant; the computing system identifying one ormore characteristics of the telephone call; the computing system usingthe one or more identified characteristics of the telephone call tocreate a header for a note document; the computing system receiving userinput comprising one or more notes that are input into the note documentby the at least one participant during the telephone call; and thecomputing system indexing and saving the note document as part of ahistory that links the one or more identified characteristics with thenote document.
 2. The method recited in claim 1, wherein the one or moreidentified characteristics comprises a telephone number of a caller. 3.The method recited in claim 1, wherein the one or more identifiedcharacteristics comprises a telephone number of a callee.
 4. The methodrecited in claim 1, wherein the one or more identified characteristicscomprises a meeting identifier.
 5. The method recited in claim 1,wherein the one or more identified characteristics are extracted fromcalendar information that is accessed by the computing system from acalendar database of the at least one participant.
 6. A computer programproduct comprising at least one hardware computer-readable storagemedium for providing access to an electronic document associated with atleast one attribute of a telephone call at a computing device thatincludes at least one processor and memory, the at least one hardwarecomputer-readable storage medium having stored computer executableinstructions which, when executed by the at least one processor,implement a method comprising: a computing system detecting a telephonecall, the computing system including a processor and memory; thecomputing system identifying one or more characteristics of thetelephone call; the computing system using the one or more identifiedcharacteristics of the telephone call to identify one or more electronicdocument associated with the one or more identified characteristics; andthe computing system displaying a selectable link to the one or moreelectronic document on an interface associated with the computingsystem.
 7. The computer program product recited in claim 6, wherein theone or more identified characteristics comprises a telephone number of acaller.
 8. The computer program product recited in claim 6, wherein theone or more identified characteristics comprises a telephone number of acallee.
 9. The computer program product recited in claim 6, wherein theone or more identified characteristics comprises a meeting identifier.10. The computer program product recited in claim 6, wherein the one ormore identified characteristics are extracted from calendar informationthat is accessed by the computing system from a calendar databaseassociated with a participant on the telephone call.
 11. The computerprogram product recited in claim 6, wherein the selectable link to theone or more electronic document is also displayed with a transfer filebutton which, when selected, transfers the electronic document to one ormore participant on the telephone call.
 12. A computing systemcomprising: at least one processor; and memory storingcomputer-executable instructions which, when executed by the at leastone processor, implement a method for providing an electronic documentassociated with a telephone call at the computing system, wherein themethod includes: the computing system detecting a telephone call, thecomputing system including a processor and memory; the computing systemidentifying one or more characteristics of the telephone call; thecomputing system using the one or more identified characteristics of thetelephone call to identify one or more electronic document associatedwith the one or more identified characteristics; and the computingsystem displaying a selectable link to the one or more electronicdocument on an interface associated with the computing system.
 13. Thecomputing system recited in claim 12, wherein the one or more identifiedcharacteristics comprises a telephone number of a caller.
 14. Thecomputing system recited in claim 12, wherein the one or more identifiedcharacteristics comprises a telephone number of a callee.
 15. Thecomputing system recited in claim 12, wherein the one or more identifiedcharacteristics comprises a meeting identifier.
 16. The computing systemrecited in claim 12, wherein the one or more identified characteristicsare extracted from calendar information that is accessed by thecomputing system and which is associated with at least one participanton the telephone call.
 17. The computing system recited in claim 12,wherein the selectable link to the one or more electronic document isalso displayed with a transfer file button which, when selected,transfers the electronic document to at least one participant on thetelephone call.
 18. The computing system recited in claim 12, whereinthe electronic document is a note document that was created during aprevious call with at least one participant on the telephone call on aninterface of the computing system.
 19. The computing system recited inclaim 18, wherein the computing system identifies the one or morecharacteristics from header data that was created and stored with thenote document from calendar information extracted from a calendardatabase associated with at least one participant on the telephone call.20. The computing system recited in claim 12, wherein the computingsystem includes a display screen that displays the interface.